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* ' ' \ 

, . The Special Education Teacher Diagnostician: * 

Professional. Trailing Needs 

. In the preceding presentation , Margaret Jo Shepherd (Note 1) 
reviewed the development and current status of the spScial education 

teacher diagnostician role. Sjfecial education teacher 'diagnosticians , 

^ >» ~ . * ' 

y .J 

or educational diagnosticians as they are now more commonly called, 
were defined as special education teachers who spend the major portion 
of their time engaged in the individual assessment of exceptional 
children. The competencies stressed as central to this role at the 
• time .of its inception in the late 1960s related primarily ^o knowledge 
of curriculum and instructional methodology. It was noted that this ^ 
stress was generated by a de9ire for evaluation^ that were more instruc- 
tionally oriented than was commonly the case. Proficiency in assessment/ 
however, wa6 not Emphasized as a primary competency for diagnosticians at 
that time. Professor She-pherd went on to define asisessment proficiency 
as th6se competencies necessary for (aj the selection^ administration, 
J and interpretation of formal tools and (b) the construction and use of • 
informal procedures.^ Finally, she noted the current increased awareness 
in special education of the importance of assessment proficiency for 
child study personnel. 

c 

The -lack emphasis originally given assessment knowledge as a 
XompeTfeiicy central to the diagnostician role led us to raise the question 
*^of educational diagnosticians' assessment proficiency. This question,^ 

like many others in special, education, is not easily answered because it 

has not been adequately researched. 
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To provide some semblance of an answer to this question, Professor 
Shepherd and I conducted a study and ^plication of educational diagnos-* 
ticians' proficiency in one aspect of assessment. 

Method \ ^ \ 

The" aspect of assessment chosen for stiitiy was knowledge and ability 
to apply basic measurement concepts of use in test interpretation. These 
concepts included reliability , validity , norms , criterion-referenced 
interpretations , measures of central tendency and variability and 
interpretive , aids . * These six content^arfeas and the process ar^as 
df knowledge ajid applic^ation were used to construct ^a^test blueprint 
-^(see^Table 1) whigh served as a -framework for developtdent of a test of 
measurement concepts. Items for the test were selected from a pool 
maintained by the Educational Psychology: Measurement and Evaluation 
Program at Teachers College, Columbia University. Thef pool is normally 
used for construction of exams in introductory courses offered by the 
proj^ram. Examples of items included in the^inal version of the 64*item 
test are presented in Table 2. ' * * 

■ ■ • • 

Subjects . 

The test of measurement concept's was given to 95 educational 'diagnos 
.ticians Selected in a nonrandom manher from a population of 800 'such 
professionals serving one U.S: state. All subjects reported holding 
master's degrees and 7351 cited special education as a major field of' " 
graduate study. In addition, participants indicated an average of 60 * . 



/ The Special Eaudaf ion 

* graduate credits earned and five yeafs experience As diagnostifcians. * 

Finally, the large majority 'ye^orted subscribing to at least one profes-- 

' ^ ' ' • • . ... 

Sional' journal (90%) and belonging to one prafessional orgahi'^ataon 

(87%). . 



Results 



^ Performance of educational diagnosticians oa the test of measurement . 

concepts was interpreted relative to maximum pq^sible ^core ClOOX correct) 

and. relative to the performance of a group of 119 students enrolled ^n atv. 

introductoi^y measurement course at Teachers College. The course is ^ 

geared to ^he needs of the classroom teacher and is m^ant to impart 

minimum competency in the basics of assessm^t in education. 

Relative to maximum possible scote, diagnosticians achieved an 

average of 50% correct on total Bc^re^ 53% correct on knbvledge , and 48% 

correct on application . In relation to students, diagnosticians p^erformed 

21 percentage points lower on total score j 19 points lower^n knowledge , 

and* 22 poihts lower on ap^lication . ^11 differences between the student. 

V, • • ^ 

and diagnostician groups were significant at the .001 level. 

■ .■ t V : 

Study IJ: Replication ,\ | 

Method 

The M-item test , of measurement concepts created for*use in Study I 
; ^ ^ k 

was also used in Study II. The method for^-the two studies was, therefore, 

essentially the same. 
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Subjects ^ ■ - ' 

Subjects iox the feplication were 39 diagnosticians selected in a 
nonrandom manner froi!^200 educational diagnosticians serving a major U,5. 
city school system. Most subjects, reported holding the master's degree 
(92Z) and more than half cited special ^ed^ucation as a major field of 
'graduate study (59Z), In addition participants indicated an, average of 
35 gi^duate credits earned and one year's experience a« educatiotial 
diagnosticians. Finally, 28Z-of the group reported subscribing to at 
least one pr.ofessional journal. ^ 

The test of measurement concepts was administered to the complete 
group of subjects in a standard-size classroom. Subjects were' allowed 

as much time as ^reeded to complete the test, ^ 

« •* 
Results , \ 

' As \n Study I, performance on the te^t of ^m^surement concepts wds 

interpreted from two perspectives. In relation to maximum possible 

score, diagnosticians achieved an average of $4Z corr||{:t for the total 

testi ^Z c^x^ect for knowledge ,, and 41Z correct for application . 

Relative tx) tho performance of the group of 119 students cited in Study 

I, diagnosticians *^cored 27 percentage points lower on total score, 26 

points lower on knowledge ," and 2^^ points ^lower on application , with all 

differences significant at the >p01^ leVel, No' s^ignif icant differences 

were found between performance of the diagnosticians in Study„I and those 

In Study II, ' ' • 
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* J Conclusion ' ' * 

» 

^'Re8^ult8 of the two research studies described in this paper suggest 
that measurement concepts of use in test interpretation' are an area of 
training need for the populations of diagnosticians ^studied. Lack of 
proficiency in these* concepts can result in the misinterpretation of , 
assessment data, the' provision of erroneous interpretations to decision^ 
makers,, and the making of inappropriate decisions about the identification, 
programming, and placement^of 'children. 

In sum, we feel we have documented, within the complex that is ^ 
assessment proficiency, a specific area of training need for educational 
diagnost iciansr v f 



Recommendations 



K Further research on educational diagnosticians' assessment 
knowledge and ^kill is badly needed. Such research is necessair^f order 
to specify areag of training need for these professionals (Bennett 6 



Lewis, Note 2). A framework tot needs-assessment research is provided by 
PL 94-142 through xt$ mandate for annual needs assessment of special 
education and related service personnel (U.S. Office of Education, 1977). 
Individuals with re'sponsibility fot statewide ti/aining efforts* should 
ensure tKat the training needs of diagnosticians are addressed within 
this framework. 
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2. Inservice training in assessment based on the results of needs- 

J- 

''assessment studies should be provided for educational diagnosticians. 
Support for such training is provided through PL 94-142^ s mandate for a 
Comprehensive System of Personnel Development (U.S. Office of Education, 

1977) which requires ^nservice education addressing ciocumented training / 
needs for regular and special education per^pnnel. 

3. Certification for diagnosticians should include requirements for 
proficiency in the various aspects of assessment. Such requirements 
should also be made a par\ of certification for special education 
resource and classroom teachers. ^ 

4. Certification for educational diagnosticians should be nonpermanent 

and .p^riodicaYly renewable. Awai;d of- initial certification and re'cert i'f i-^ 

cation should be based in part , on objective evaluation of knowledge, 
^ < — ^ 

skill, and performance in those areas critical to success in^the diagnos- 
.tician role. An initial set of guidelines for such evaluation is provided 
by Bennett* (in press). * . 

5. The assessment proficiency ar^a of basic measurement concepts 
should be included in future revisions of the Code of Ethics and Compe- 
terteies for Teachers of Learning Disabled Children aitd Youth (DCLD, 

1978) '. • \ 

- ■ ' '7 ' .. 
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> Footnote' 

A more comprehensive description of the methodology, subjects, and 
results of Study I is presented i*h Bennett (1980), 
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" Table ^1 
Teat Blueprint 



Content 



ProceBB 



9jpllablllty * Validity 



Horns 



Knowle 




Definition • 

SEia 

Reli ability 
of differences 
.ReligbUity 
coeffdctent . 
Reliability & 
criterion- 
- reference 



DefiuCticn 
Validity 
coefficient 

V 



'Measures of 
Central Tendency 
k Variability 



j>i:terlon- 
Aferenced 
tnterpretatlone 



fnterpretlve To- 
Alda^ -tale 



Uses 

Typee of 
Bcorea 



Mean 



Definition 
"Limitations 
VseB ^ 



Uses of 

Bpeclflc 

Bounces 



Application Reliability 
- , coefficient 
SBm 

* Confl'dence 
Intervals 
C3) 
5^ 



9) 



(1) 
25< 



EvlTliftnce 
needed for 
different 
types 

(7) 

11J< . ' 



Jnterpre- Interpretation of 
tatlon of scores given 
scores ' & SD of. test 



(12)- 
-195t 



(5) 



\t - 

m 

Identifying 
appropriate, 
situations 
for use 

(l) 



(5) 

Selecting 
sources 



(3) 
5^ 



(33) 
52^ 



(31) 



Miftls * (12) 
19!t . 



til) 
17^- 



£0 
9;< 



(6) 
9^ 



(8) 
13J« 




■ _t21) 

* Nubbers^ In parentheses Indicate number of Itijira 

^ All percentages are appr^lmate and hence some,tlmes do not correctly sum across columns' or i*ows 



(64) 
100!< 0 
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" TabU i 

Examples of Items Used on the. Test of Measurement Concepts 



i 



1. In addition to knowing how precise and accurate ,a measurement procedure is, 
the most important thing to know is bow . 

'*A. relevant it is to the decision we must mak-e. 

B. adequate the units are in which scores^are expressed. ' ' • 

C. fair the procedure is to groups with differing backgrounci^. 

D. much the proceciure intrucles intp the examinee's privacy-. 

^ \ ' ^ 

2. Which of the following statements is justified in terms of the given . 
information? 

M^th Test * Spilling Test 

John's, score 60 ' 35 • 

Group mefan ^ 50 25 

Standard^eviat ion ^ 10 6 

*A. John did better in spelling than in math, 

B. John did better in math'than in spellirvg. 
1- C. John did equally well in >oth tests. 

D. There is no basis for comparing John's 
^ performance on the two tests. 

3. *If one war^ted to find critical reviews of the Key Math DiTAgnostic Arith- 

metic Test, one might best consult ^ 

*A . BlJ^ros — The Mental Measurements Yearbook 

B: Measurement and Evaluation in Guidance . 

C. the manual (j| the test. 

D. Educational and Psychological Measurement . ^ 

A. An indiviVral's score on an achievement test is 75. The standard err6r of 
measurement for the test is reported to be five points. What are the 
chances that the individual's true score is between 70 and 80? 

/ 

A. About 9 chances in .10. 
*B, About 2 chances in 3. 

C. About 1 chance in 3» 

D. About 1 chance in 6. 
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